Speed Gradient and MaxEnt Principles for Shannon and Tsallis Entropies
نویسندگان
چکیده
In this paper we consider dynamics of non-stationary processes that follow the MaxEnt principle. We derive a set of equations describing dynamics of a system for Shannon and Tsallis entropies. Systems with discrete probability distribution are considered under mass conservation and energy conservation constraints. The existence and uniqueness of solution are established and asymptotic stability of the equilibrium is proved. Equations are derived based on the speed-gradient principle originated in control theory.
منابع مشابه
Speed Gradient and MaxEnt principle for Shannon and Tsallis entropies
The notion of entropy is widely used in modern statistical physics, thermodynamics, information theory, engineering etc. In 1948, Claude Shannon introduced his information entropy for an absolutely continuous random variable x having probability density function (pdf) p. In 1988, Constantino Tsallis introduced a generalized Shannon entropy. Tsallis entropy have found applications in various sci...
متن کاملA Preferred Definition of Conditional Rényi Entropy
The Rényi entropy is a generalization of Shannon entropy to a one-parameter family of entropies. Tsallis entropy too is a generalization of Shannon entropy. The measure for Tsallis entropy is non-logarithmic. After the introduction of Shannon entropy , the conditional Shannon entropy was derived and its properties became known. Also, for Tsallis entropy, the conditional entropy was introduced a...
متن کاملNetwork Entropies of the Chinese Financial Market
Based on the data from the Chinese financial market, this paper focuses on analyzing three types of network entropies of the financial market, namely, Shannon, Renyi and Tsallis entropies. The findings suggest that Shannon entropy can reflect the volatility of the financial market, that Renyi and Tsallis entropies also have this function when their parameter has a positive value, and that Renyi...
متن کاملChain rules and subadditivity for Tsallis entropies
Chain rules for Tsallis type entropies are proven, as including the famous pseudoadditivity in nonextensive statistics as a special case. They give important relations between Tsallis conditional entropy and Tsallis joint entropy. Moreover the subadditivity of Tsallis type entropies is shown for the correlated two random variables in the case of q ≥ 1 with the help of the generalized Shannon in...
متن کاملShannon, Tsallis and Kaniadakis entropies in bi-level image thresholding
The maximum entropy principle is often used for bi-level or multi-level thresholding of images. For this purpose, some methods are available based on Shannon and Tsallis entropies. In this paper, we discuss them and propose a method based on Kaniadakis entropy.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Entropy
دوره 17 شماره
صفحات -
تاریخ انتشار 2015